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DESELECTION: A NOVEL APPROACH 
TO THE PEER SELECTION PROCESS 



Abstract 

The purpose of this project was to devise a peering 
procedure which would be technically defensible, yet simple and 
equitable enough to allow agreement by both faculty and 
administration of not only the peering process but also the 
products of the ensuing salary study. A national IIA data base 
was built in LOTUS 1*2-3 format of secondary enrollment, revenue, 
and institutional data. A joint faculty-administrative advisory 
committee eventually negotiated the selection of five key data 
elements.. Institutions not possessing these characteristics were 
"deselected. 11 Tha remaining forty-four schools became the agreed 
upon base for the national faculty salary survey. 



Background and Problem 



In 1984 the Office of Institutional Research at Northern Michigan 
University conducted a salary study as the primary means for 
determining how a small pool of salary equity funds would be 
distributed among the faculty. The comparative salary 
information was derived from a midwestern data base. Beginning 
with a population of forty-two public IIA institutions in the 
states of Illinois, Indiana, Michigan, Minnesota, Ohio and 
Wisconsin, twenty- three schools were chosen by the four members 
of an administrative advisory group. Surveys were sent out and 
data from the respondents became the source for the salary equity 
study. The results were presented to the faculty representative 
of the collective bargaining unit. while there was some 
questioning of motives and the peer selection strategy, 
eventually the equity funds were distributed without a great deal 
of rancor. For this researcher, two clear messages emerged from 
this effort. First, a more effective and more defensible peering 
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mechanism would have to be developed. Second, in order for the 
process to be a credible one, faculty as well as administrative 
representatives needed to be actively involved at each and every 
stage of the peering and salary survey process. 

Problem 

With the faculty contract expiring in 1987, the President of the 
University indicated that a salary study would be conducted and 
also that this study would employ a national peer group. The 
problem, simply stated, was how to produce this national peer 
group and the resulting salary data base in such a fashion that 
it would be accepted and utilized by both faculty and 
administrative representatives who were involved in the 
collective bargaining process. 

Relevant literature 

In the 1960 f s and early 1970' s, the process of peering had 
largely been a judgmental exercise, in which the investigators 
selected institutions which were similar to their own, With the 
aggressive intrusion of state legislatures, Boards of Highar 
Education and Trustees, the methodology has changed. The State 
of Kansas has been particularly involved in this process. The 
methodologies employed in this state (see e.g., Cleaver, 1981; 
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Rawson, Hoyt & Tester, 1983; Teeter and christal, 1984) are 
basically representative of current approaches where HEGIS-like 
data are employed to select institutions and then sophisticated 
weighing formulae are utilized to adjust for the inevitable 
interinstitutional differences. 

In one sense, the peering process is akin to pairing in 
experimental research in that when you pair on one variable you 
tend to "unpair" on ten others. The pressing methodological 
problem is the critical need to determine which ars the essential 
elements or factors which need to be paired. Once this is 
decided, the next step is a simple one. Those institutions which 
do not match these key criteria are eliminated or "deselected." 
The choosing of the essential criteria must be negotiated by the 
participants, if it is to tie them into the process and to 
inspire confidence that the process has been an open and 
equitable one* 

Methodology 

Data Base Development 

The March/April 1986 Issue of Academe - "The annual report 
on the Economic Status of the Profession 1985-1986" was 
utilized as 'the source document for the population of 
institutions. Northern Michigan University is a IIA 
institution which signifies that it is a "comprehensive 
institution with diverse post-baccalaureate programs, but 
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without significant doctoral-level education. ( Academe, p. 
18) . 11 All 344 IIA institutions in the continental united 
States were identified and became the population for the 
study. A search was then made of easily attainable data 
elements for these 344 IIA institutions. In all, a total of 
fifty- two enrollment, revenue and institutional descriptions 
were collected for each institution. Five major types of 
data elements were collected and the major source documents 
are listed below. 

1. Student Related Data- 
Annual survey of Colleges - Fall Enrollment 1985 
(The College Board). 

2. Faculty Related Data- (but not salaries) 

"The Annual Report on the Economic status of the 
Profession 1985-86" , Academe, March/April, 1986. 

3. Institutional Descriptors- 

19 86 Higher Education Directory . 

4. State Appropriations- 

" State Appropriations for Higher Education (The 
Hines Report), The Chronicle of Higher Education. 

5. Revenue Ratios- 

Chronical of Higher Education Management Ratios 2 , 
Ed. by John Minter, National Data service. 

Each of these data elements was taken from these secondary 
sources and was incorporated into an extremely large (360K) but 
very flexible data base. The data base was build in LOTUS 1-2-3 
format and was eventually transferred onto floppy diskettes. 
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The construction of the data base was a labor intensive effort 
and required considerable concentration and a lengthy 
verification process to insure accuracy. Nonetheless , it was a 
clerical process and could be handled by support staff. The 
development and editing of the data base was completed in the 
period from October through the first week in December of 1986. 

B. Advisory committee Process 

As the development of the data base proceeded, a joint 
faculty-admiuistrative advisory group was convened. Two 
faculty members participated in the process, including one 
hired by the faculty union for his expertise in computer 
methodology. The director of Human Resources (the chief 
negotiator for the administration) and the Comptroller were 
appointed as the administrative representatives. The group 
met for the first time in November and met on a bi-weekly 
and then a weekly basis through the end of January of 1987. 

C Project Implementation 

As discussed previously, there were two equally important 
goals for this phase of the salary study project. First, it 
was critical to develop an effective mechanism for 
identifying institutions comparable to N.M.U. across a 
number of key dimensions. Second, it was essential to 
create a climate which would enhance a bonding to the 
process and a sense of responsibility for the outcome 
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for all the participants. To this end, meticulous attention 
was given to the explanation of each variable, its source, 
its weaknesses, or if any coding schema or special 
interpretation was necessary for an understanding of that 
particular variable. Original source materials and detailed 
documentation were offered for each of the fifty-two 
variables. As the data base was being build, each member of 
the advisory group was provided with working copies of the 
current form of the data file. Finally, each participant 
was encouraged to probe the data base in order to identify 
additional variables. For example, the data base contained 
a variable containing state appropriations and another 
element had to do with enrollment ~ One inquiry involved a 
calculation of State appropriations per headcount. Each of 
these inquiries was handled by the next meeting of the 
advisory group. 

A more subtle objective of the whole salary study process 
was to maintain the hard-won perception of neutrality (or 
something approaching neutrality) for the Office of 
Institutional Research. It is true that it was not possible 
to achieve a complete climate of "trust" among all the 
participants. However, it was both satisfying and somewhat 
amusing that both the faculty and administrative 
representatives expressed on several occasions, a sense of 
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uneasiness because of their lack of control over the outcome 
of either the peer selection procedure or the salary data 
which eventually would be collected. 

Results 

The data base of fifty-two variables for each of the 344 IIA 
institutions was completely developed by the beginning of 
December and was distributed to the advisory group (a copy 
of the data base is included as Appendix A) . By the second 
week in December, the advisory body had as a first step 
tentatively identified six criteria that seemed essential. 
These involved: 

1. the mission of the institution (e.g., comprehensive 
institutions but without a major Medical or Engineering 
Emphasis) ; 

2. the level of offerings (i.e., significant master's 
offerings or master 1 s + offerings, but no doctoral 
programs) ; 

3 the type of locale (i.e., an attempt to get at the 
remoteness/centrality of an institution to a 
metropolitan region); 

4. the number of faculty members; 

5. the undergraduate enrollment; 

6 . the full-time undergraduate enrollment ( i . e * , an 
attempt to get at the commuter, part-time/full-time mix 
of undergraduates. 

Using these tentative criteria a total of 297 institutions were 
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deselected. The schools and the criteria were examined very 
closely, over the next six weeks numerous iterations of these 
original criteria were discussed, and modeled and rediscussed. 
Modifications included tightening and broadening enrollment and 
faculty ranges and adjusting the ratios of full-time versus part- 
time students. The most attention, however, focused on the city 
size/remoteness issue. A wide variety of arguments ranging from 
recruitment costs/opportunities; to opportunities for consulting 
for faculty were raised and challenged. By the end of January 
with impending deadlines rapidly approaching, the administrative 
members of the advisory group decided to drop their support for 
the inclusion of a city size variable. The final negotiated 
criteria (see Appendix B) paralleled very closely the original 
list of variables. Using those criteria, 299 schools were 
deselected and a total of forty-four institutions were deemed to 
be peers of Northern Michigan University as far as the five key 
negotiated criteria were concerned. (See Appendix C) 

One final step remained. A survey instrument was prepared and 
distributed to the advisory group. After a few suggestions the 
modified instrument was mailed on February 4, 1987. 
Conclusions 

From the population of forty-four possible peer 
institutions, twenty-four schools (besides N.M.U.) chose to 
participate in the study. Faculty salary data was collected from 
over 7,000 faculty members from the participating institutions. 
(See Appendix D). 
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I mplications 

The construction of the data bases in this project were a time 
consuming and labor intensive process. However, the source 
documents are easily attainable and generally can be obtained at 
a limited cost. The development of this type of data base can be 
handled by support staff and once it is in place, it is an easy 
to use and very flexible tool for the academic administrator. 
The data basa at Northern Michigan University has been used in 
the faculty salary study, and has also been utilised by the 
Graduate school to identify peer institutions for a Graduate 
school survey which it has now completed* The personnel office 
is in the process of conducting an administrative staffing survey 
and will utilize the data base and the participants in the salary 
survey to select peers. Finally, it is being recommended that 
some departments, such as nursing, use the data base to identify 
peer programs in order to provide comparable cost, staffing and 
productivity figures. 

Virtually any institution, at any level or of any size, can build 
a data base similar to Northern Michigan's for its referent 
institutional pool. Once it is in place, it will allow a school 
to respond in a timely fashion to requests for peer group 
information as well as to effectively evaluate the 
appropriateness of any specific institutions which are advanced 
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as peers by some external agency, if updated on an annual basis, 
It can continue to serve the institution as a useful management 
tool. 
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APPENDIX B 



January 23, 1987 



National Data Base 
Selection criteria 
Final Version 



Deletion Criteria 

(1) DOE Code NE B01 

(2) OE Code NE 6 or 7 

(3) Total # Faculty 
LT 93 or GT 443 

(4) undergraduate Enrollment 
LT 4,719 or GT 8,719 

(5) Full-Time Undergraduate 
Enrollment of 3,796 

or GT 6,796 



No. of Institutions 



Deleted 
25 
83 
65 



111 
15 



Left 
319 
236 
171 

60 
45" 



-includes Northern Michigan University. 
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APPENDIX C 
1986 NORTHERN MICHIGAN UNIVERSITY 
FACULTY SALARY STUDY 
SURVEY POPULATION 



INSTITUTION 

Jackson State University 
Georgia Southern College 
Murray State University 
Nicholls State University 
University of Southern Maine 
Southeastern Mass Univ 
Grand Valley State College 
Univ Minnesota-Duluth 
Kearney State College 
Willian Paterson College 
Suny College At Cortland 
Suny College At New Paltz 
Suny College At Oswego 
Suny College At Plattsburgh 
Blooms burg University 
Kutztown University 
Shippensburg University 
Univ Tennessee-Chattanooga 
Norfolk State University 
Central Washington Univ 
Eastern Washington Univ 
Univ. Wisconsin-River Falls 
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NEWY 


5,217 


NEWY 


6.225 


Suny College At Oneonta 


NEWY 


D./bl 


PENN 


6,439 


Western Carolina University 


NORC 


5,935 


PENN 


6,252 


Clarion Univ. of Penn-Main 


PENN 


6,608 


PENN 


6,225 


Edinboro University 


PENN 


5,849 


TENN 


7,553 


Millersville Univ of Penn 


PENN 


6,628 


VIRG 


7,185 


Slippery Rock University 


PENN 


€.496 


WASH 


6,993 


Angelo State University 


TEXA 


5,881 


WASH 


7,838 


Radford University 


VIRG 


6.903 


wise 


5,703 


Univ Wisconsin-Platteville 


wise 


5.873 






Univ Wisconsin-Stout 


wise 


7.730 
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APPENDIX D 



NORTHERN MICHIGAN UNIVERSITY 1986 
NATIONAL FACULTY SALARY STUDY 

LIST OF PARTICIPATING INSITUTIONS 

STATE INSTITUTION NUMBER OF FACULTY 



Arkansas 

* » 1 9 >C4I IwUw 


Arkansas State Universitv 


350 


Georaia 


Georaia Southern Colleae 


272 


Illinois 

• III * Iwlw 


Northeastern Illinois Universitv 

f V >^ 1 % I ■ W MW * \> 19 1 » 9 9 9 9 9 9 W Mil W 9 W • » J 


342 


Kentucky 


Murrav State Universitv 

I » I wl | | V4 1 % W% % V VI V 1 % W 


345 


Louisiana 


Southeastern Louisiana Universitv 

*^9^91 I IVUWIV 9 9 1 9»»»#%<9 9 VIMI 9%* 9 99 V \# 9 Wl 9> W 


256 


Michioan 


Grand Valley State Colleqe 

1 VII 1%^ w fl w ^9** fl> **^fl>%^ • • 


217 


Michioan 


Northern Michigan University 


275 


Minnesota 


Moorhead State University 


263 


Minnesota 


University of Minnesota-Duluth 


244 


Missouri 

■ VII *" 9 9 


Northeast Missouri State Univ. 


270 


New York 


SUNY College at Brockport 


328 


New York 


SUNY College at Cortland 


259 


New York 


SUNY College at Geneseo 


235 


New York 


SUNY College at Oneonta 


282 


New York 


SUNY College at Pittsburgh 


246 


North Carolina 

1 « vl III Will IM 


Western Carolina University 


245 


Pennsylvania 


Edinboro University 


310 


Pennsylvania 


Millersvilie Universit 


310 


Pennsylvania 


Shippensburg University 


294 


Pennsylvania 


Slippery Rock University 


351 


Tennessee 


Univ. of Tennessee-Chattanooga 


258 


Virginia 


Radford University 


324 


Washington 


Central Washington University 


252 


Washington 


Eastern Washington University 


335 


Wisconsin 


U. of Wisconsin-Plattevilie 


216 




TOTAL OF ALL INSTITUTIONS 


7,079 
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